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ABSTRACT 

A new approach to flying qualities specification and evaluation is presented 
which coordinates current research in the areas of pilot ratings, pilot-aircraft 
modeling techniques, and simulation and flight test procedures. A time-domain pilot 
model is described which can model discontinuous and nonlinear pilot behavior in 
conjunction with completely general time-varying nonlinear aircraft models to simu- 
late discrete manuevers. This pilot-aircraft model is applied to an existing set of 
in-flight simulation data, and calculates tracking error and time-on-target statistics 
for step target tracking that directly relate to the reported pilot comments and ratings. 
Predicted step target tracking data for eighteen F-5E flight conditions are presented, 
and the use of the method for control system design is demonstrated using the YF-17. 


INTRODUCTION 

Pilot ratings and pilot comments often refer to two basic kinds of evaluation: 

1) How well can the aircraft be made to perform? 

2) How hard is the task to carry out? 


Since these two questions are asked simultaneously by the Cooper-Harper 
decision tree employed by the pilot in assigning a rating, performance and pilot work- 
load are combined into a single scalar quantity, the rating. Pilot rating prediction 
formulas have been developed that weight normalized statistical performance, usually 
an rms tracking error, along with an assumed correlate of pilot workload, such as the 
pilot lead compensation constant. Although these methods have correlated well with 
steady state tracking data, the predictive and practical aspects of this approach have 
yet to be demonstrated, especially in view of the simplifications required in task 
descriptions and system models. One basic problem with these approaches is that 
pilot model parameters of lead, reserve attention as defined by additional task 
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to respond well to such discrete corrections in a short tracking time is therefore of 
great importance to flying qualities analysis. This is particularly true in target track* 
ing where the target must first be acquired and then precisely tracked. 

It is clear that the objectives of quick initial response and precise tracking once 
the target is acquired are to some degree opposed. If the pitot pulls the airplane toward 
the target too rapidly, unwanted overshoot and oseiltatkm about the target may result. 

On the other hand, putting too slowly to the target may lead to steady tracking but with 
a penalty of unacceptably stow target acquisition. The ability to investigate this com- 
promise and predict how well the overall task can be achieved for a given aircraft is 
the primary advantage of using time-domain pilot models to investigate step target 
tracking. 

Consider a target that suddently appears above steady-state trim pitch for the 
tracking aircraft. The pilot sees the target and initiates a pull-up. At some point, say 
0 seconds into the maneuver, he will possibly change the nature of his control to initiate 
precision tracking and reduce steady-state errors. By repeatedly flying this maneuver, 
he will learn just how much he can force a quick initial response without producing over- 
shoot and oscillation. The performance of this step target tracking task can then be 
measured by rme tracking error and time-on-target for a given pipper sire and total 
tracking time. 

The Northrop time-domain pilot model. Reference 3, is set up to perform this 
tracking task in just the way the pilot does it as described above. This is shown in 
Figure 1. There will be two forms for the pilot compensation elevator command 
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one which provides the Initial target acquisition, and the other after time D has passed 
which controls final precision tracking and eliminates steady state errors. These are 
of the forms 
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Figure 1. Definition of Step Target Tracking Task 

where 0 e is pitch angle tracking error and the subscripts I and F refer to initial 
acquisition and final tracking, respectively. The K JC term represents a pilot's 
avoidance of steady state error by means of integral control, A pilot delay of 
t = o. 3 sec will be used. 

The following quantities must be adjusted in order to perform a simulation of this 
step tracking task for the evaluation of a given aircraft configuration: 

K p , T 
I 

This adjustment is performed using an optimization principle. For the analysis of 
step target tracking, it will be assumed that the pilot optimizes tlme-on-target and 
that this leads to the best compromise of rapid target acquisition and steadiness of 
target tracking. The adjustment rule for the pilot model is thus: choose the param- 
eters any way that leads to maximum time-on-target. 
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PILOT - AIRCRAFT ANALYSIS OF LONGITUDINAL STEP TARGET TRACKING 

One of the most familiar and widely employed guides to longitudinal flying qualities 
is the data obtained by Neal and Smith of Cornell Aeronautical Laboratory during an 
In-flight simulation sponsored by the Air Force Flight Dynamics Laboratory in 1970. 

The test matrix Included variations in short period frequency, damping, and control 


system parameters. Flight test evaluation included pitch angle tracking of both random 
and step commands. The reported pilot ratings and pitot comments cover stick forces, 
predictability of response, attitude control/tracking capability, normal acceleration con- 
trol, effects of random disturbances, and IFE problems. Most pilot comments deal with 
initial response ("predictability of response") or precision attitude tracking control 
("attitude control/tracking capability"). 

Forty-two configurations, Series 1 through 7, were calculated and presented in 
Reference 3. A pipper diameter of 0. 005 radian, a step size of 0. 2 radian, and a total 
tracking time of 5 seconds were adopted. Since the system was linear, any choice of 
step and pipper size that preserves the 40 to 1 ratio will lead to the same time-on- 
target and normalized rms statistics. 

Figure 2 shows the calculated step tracking response of one of the better configur- 
ations surveyed, 7C, which was given a rating of PR = 1.5. In this case, the rapid 
acquisition of the target leads to low rms while die steadiness of the precision 
tracking results in large time-on-target. On the other hand. Figure 3 shows a poor 
configuration, IF (PR = 8), that has sluggish response Indicated by high rms 6 e . Even 
worse is the inability of this configuration to settle out on the target, so that time-on- 
target is mostly achieved during target crossings. Other configurations show a wide 
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Figure 2. Configuration 7C Step Tracking Response 
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Figure 3. Configuration IF Step Tracking Response 

range of specific handling qualities problems; aircraft that exhibit great overshoot and 
others whose steady-state error is difficult to overcome, even with the use of the 
integral control compensation. 

The primary objective of the flying qualities specifications, called out in 
MIL-F-8785B, is to establish numerical criteria that define levels of performance in 
terms of pilot ratings: Level 1 - PR 1-3. 5, Level 2 - PR 3. 5-6. 5, and Level 3 - PR 
6* 5-9* 5* 

It is useful to examine the correlations of the rms * and time-on-target data 
calculated for the Neal and Smith configurations with pilot ratings. The rms 0 e data 
are presented in Figure 4. The expected result of increasing pilot rating number with 
increasing rms © e is clearly shown. However, if an attempt is made to draw ’ specifi- 
cation boundary as a vertical line at some rms 0 e value, in order to specify the per- 
formance in Level 1 or 2, the result is that no lines can be drawn that do not also in- 
clude many points from the wrong levels. This failure of rm» 0 e to correlate with 
pilot ratings sufficiently well for specification purposes has been frequently noted. 
From the description of the piloted task, it is clear that the rms 0 e statistic is inci- 
dental, time-on-target being the primary performance- measure. If calculated time- 
on-target is plotted against pilot ratings, there Is again a strong correlation, as shown 
in Figure 5. Unfortunately, this correlation is even less able to furnish specification 
boundaries than the rms 0 g vs pilot rating data. 
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CORRELATION OF STEP TARGET DATA WITH NEAL-SMITII 
PILOT RATINGS 
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Level If the resulting time-on-target is especially good, and conversely. Since the 
^meters rms e e and time-on-target correlate with pilot ratings obtained during a 
fLght test program that examined various tracking tasks, the representation of target 
tracking by the step target appears to be justified. 

VALIDATION OF THE STEP TARGET METHOD USING THE F-5E AIRCRAFT 

, VaUdatl ° n 0f the method was obtained by comparing F-5E aircraft with 

w ou control augmentation at nine flight conditions representative of the primary 
maneuvering envelope. Full data is given in Reference 3 from which the examples 
shown m Figures 7 and 8 are drawn. P 

Comparison In Reference 3 „f the 8tep tracking response3 for eac „ „ oon(|i _ 

I” a “ gmCnter slws lhe of proper augmentation for good 

log response. the augmented cases, the initial response Is taster as reflected 
in the rms tracking error statistic, while the better damped dynamics lead to larger 
time-on-target values. To demonstrate the validity of the boundaries shown in Fig- 
ure 6 based on the Neal-Smlth data, the F-5E response data is plotted on these 
boundaries In Figure 9. Since the augmented F-5E has good Level 1 ilying qualities 
while die unaugmented aircraft may or may no, meet Level I criteria, the Uve, 1 
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Figure 7. F-5E Case 4 Step Target Tracking Response 
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YF-17 CONTROL IMPROVEMENT DESIGN EXAMPLE 

Recently, the step target method was used to evaluate and study possible control 
configuration improvement of the YF-17 aircraft. The baseline aircraft was designed to 
meet the Neal-Smith flight control criteria, but a multi-parameter perturbation of con- 
trol constants has led to improvements in predicted tracking performance. Flight 
simulations are now planned to verify these predictions, which involved only small changes 
in control parameters. 

The predicted improvements are shown for a number of flight conditions in Figure 
10. Time-on-target and rms tracking error are plotted against the boundaries shown in 
Figures 6 and 9. The tail of each arrow represents the baseline YF-17 as flight tested, 
and the head shows the predicted response of the aircraft with the modified control 
design. It Is clear that these small changes in the control parameters have produced 
substantial improvements in the predicted tracking performance. It should also be 
pointed out that these calculations were performed using the full nonlinear YF-17 air- 
craft and control descriptions. 



Figure 10. Predicted Improvement of Baseline YF-17 
Step Target Tracking 
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The tracking improvements shown in Figure 10 were calculated using the same 
modified control parameters in each case. The most striking of the time-on-target 
improvements is seen by comparing the baseline step response shown in Figure 11 with 
the modified performance shown in Figure 12. The flight condition for this case is 
Mach 0.6 at sea level. 



Figure 11. Step Target Tracking Response of Baseline YF-17 



Figure 12. Step Target Tracking Response of Modified Y F-17 
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SPECIFICATION OF AIR-TO-AIR TRACKING PERFORMANCE 

The success of the step target tracking prediction method allows the following sug- 
gestions for tracking performance specification. For a specification to be a useful, 
discriminating, and fair criterion for tactical aircraft procurement, the following 
items must be satisfied: 

1) The specification item must be numerical. 

2) The specification item must correlate with pilot comments and pilot ratings. 

3) The specification item must be easily measured in flight test or flight 
simulation. 

4) The specification item must be reliably predictable by analytical means for 
use in early design and development ' ..nation. 

5) The method that predicts the specification item must be applicable in a 
completely standardized form that evaluates the most general models of 
the candidate aircraft available. 

6) The specification item must be valid for all current acceptable aircraft, and 
must exclude poor or unacceptable aircraft. 

Unfortunately, these six requirements for military specification criteria have 
not all been met by any steady-state approach to the precision tracking problem. 
However, the transient method of step target tracking potentially satisfies these 
items. In particular, the step target method has the following characteristics that 
correspond to the requirements llsted‘above: 

1) The step target method is based on the numerical measures of rms 
tracking error and time-on-target as shown in Figure 6. 

2) The two measures correspond with pilot comments in the following way: 

rms tracking errror: Quickness of response and over- 

shoot characteristics 

time-on-target: Steadiness on target and precision 

tracking characteristics 

In addition, these two measures strongly correlate with pilot ratings 
obtained by Neal and Smith. 
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3) The use of step target tracking is already an established flight test pro- 
cedure. It is completely standardized and easily tested. 

4) The step target response is easily predicted for longitudinal step target 
tracking, and the extension to multiaxis target tracking is straightforward. 

5) The method can be used with all representations of candidate aircraft from 
tinear to full nonlinear equations. 

6) The method clearly establishes performance boundaries for the Neal-Smith 
and F-5E aircraft. The only remaining requirement for MIL-F-8785B in- 
clusion is further validation by current advanced tactical aircraft. 

FINAL REMARKS 

Pilot ratings have been successfully correlated with regions in the two-dimensional 
space having calculated rms tracking error and tlme-on-target coordinates for the 
in-flight simulation data obtained by Neal and Smith. This shows the generality, 
versatility, and practicality of time-domain pilot models. By demonstrating analytically 
the tradeoff between target acquisition and precise tracking for a short tracking period, 
the interrelationships of pilot ratings, the dynamics of pilot control compensation, and 
discrete maneuver flight test procedures are made clear. Validation by F-5E aircraft 
and a control improvement design study of the YF-17 further demonstrate the use and 
practicality of the method. It is expected that future research into multiaxis step tar- 
get tracking will yield similar correlations with flight test data. In the meantime, the 
time-domain pilot model can be readily used to evaluate a wide variety of continuous and 
discrete tasks encountered in the flying qualities of modem high performance aircraft. 
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